From circular ordinal regression to multilabel classification

نویسندگان

  • Dieter Devlaminck
  • Willem Waegeman
  • Bruno Bauwens
  • Bart Wyns
  • Patrick Santens
  • Georges Otte
چکیده

Several applications domains like wind forecasting in meteorology and robot control in robotics demand for learning algorithms that are able to make discrete directional predictions. We refer to this problem setting as circular ordinal regression, since it shares the same properties as traditional ordinal regression, namely the need for a specific model structure and order-preserving loss functions. This article gives a detailed introduction to the topic and proposes two methods. The first one is a circular support vector approach (cSVM), parameterized with only two vectors. The second method converts circular ordinal regression to a multilabel classification approach that takes the circular ranking into account by minimizing the Hamming loss. We also present initial empirical results based on two toy examples and a real-life application in the area of brain-computer interfaces.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Graded Multilabel Classification: The Ordinal Case

We propose a generalization of multilabel classification that we refer to as graded multilabel classification. The key idea is that, instead of requesting a yes-no answer to the question of class membership or, say, relevance of a class label for an instance, we allow for a graded membership of an instance, measured on an ordinal scale of membership degrees. This extension is motivated by pract...

متن کامل

Predtron: A Family of Online Algorithms for General Prediction Problems

Modern prediction problems arising in multilabel learning and learning to rank pose unique challenges to the classical theory of supervised learning. These problems have large prediction and label spaces of a combinatorial nature and involve sophisticated loss functions. We offer a general framework to derive mistake driven online algorithms and associated loss bounds. The key ingredients in ou...

متن کامل

MLSLR: Multilabel Learning via Sparse Logistic Regression

Multilabel learning, an emerging topic in machine learning, has received increasing attention in recent years. However, how to effectively tackle high-dimensional multilabel data, which are ubiquitous in real-world applications, is still an open issue in multilabel learning. Although many efforts have been made in variable selection for traditional data, little work concerns variable selection ...

متن کامل

Combining Instance-Based Learning and Logistic Regression for Multilabel Classification (Resubmission)∗

Multilabel classification is an extension of conventional classification in which a single instance can be associated with multiple labels. Recent research has shown that, just like for standard classification, instance-based learning algorithms relying on the nearest neighbor estimation principle can be used quite successfully in this context. However, since hitherto existing algorithms do not...

متن کامل

Ordinal Regression by Extended Binary Classification

We present a reduction framework from ordinal regression to binary classification based on extended examples. The framework consists of three steps: extracting extended examples from the original examples, learning a binary classifier on the extended examples with any binary classification algorithm, and constructing a ranking rule from the binary classifier. A weighted 0/1 loss of the binary c...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2010